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ABSTRACT 

This study is the fourth in a series of reports from 
the Reading-to-Write Project, a collaborative study of students' 
cognitive processes at one critical point of entry into academic 
performance. The study of task representation reported here explores 
how students and teachers perceive the same writing assignment by 
comparing the reported representations of a reading-to-write task 
from freshman writers with the essay evaluations from trained judges. 
Subjects, 72 students enrolled in four sections of a freshman 
composition course, received a follow-up assignment to revise their 
first draft of a time management essay. The experimental group 
received instruction in "organizing plans" and an introduction to 
writing issues in task representation, and completed a Self-Analysis 
Checklist (S-AC). The control group received the lecture (minus the 
revision assignment) and an introduction to the self-analysis 
procedure. Trained judges then rated the essays produced by both 
groups. Comparison of the judges' and the students' representation of 
the task indicated that judges and students disagreed far more than 
they agreed on features in the final product, but that these rival 
perceptions could be tempered by prompting and instructing students 
to "interpret with a purpose" when they revised a first draft. 
Results also indicated that the bases for the different perceptions 
and expectations are the more interesting and practical findings from 
this study. (Five figures and three tables of data are included; the 
Reading-to-Write study reference list, the S-AC, and an appendix of 
data are attached.) (RS) 
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Preface to the Reading-to-Write Reports 



So I'm just gonna--I don't care, I'm just going to interpret them the 

only way I can interpret them Let's just put what the authors 

agreed on. Authors agree -- We'll just -- If at least two of them 

concur, we'll say they agree. Authors in general agree that 

But then they don't agree -- There's nothing you can say about 
this 

Can I leave it at that Oh give me a break, I don't know what 

I'm doing. I'm only a freshman. I have no idea what to do. 

Darlene, a first-semester freshman 

Darlene's college assignment asked for synthesis and interpretation. The paper 
she turned in--a short, simplistic review of material from her sources-failed to meet 
her own expectations and her readers'. And yet, a chance to look at the process behind 
this unsophisticated product revealed serious thinking, a complicated, if confused, 
decision process, and a trail of unused abilitic and discarded ideas--an active encounter 
with academic discourse that her teacher would never see. 

The study presented here takes an unusually comprehensive look at one critical 
point of entry into academic performance. It shows a group of freshmen in the 
transition into the academic discourse of college, looking at the ways in which they 
interpret and negotiate an assignment that calls for reading to write. On such tasks, 
students are reading in order to create a text of theii own, trying to integrate information 
from sources with ideas of their own, and attempting to do so under the guidance of a 
purpose they must themselves create. Because these reading- to- write tasks ask 
students to integrate reading, writing, and rhetorical purpose, they open a door to 
critical literacy. Yet this same interaction often makes reading-to-write a difficult 
process for students to learn and to manage. 

In order to get a rounded picture of cognition in this academic context, the study 
looks at the thinking processes of these students from a number of perspectives, 
drawing on think-aloud protocols of students writing and revising, on interviews with 
and self-analyses by the students, and on comparisons of teachers' and students' 
perceptions of texts the students wrote. It attempts to place these observations within a 
broader contextual analysis of the situation as students saw it and the social and cultural 
assumptions about schooling they brought with them. 

What this study revealed were some radical differences in how individual students 
represent an academic writing task to themselves-differences which teachers might 
interpret as a simple indication of a student's ability rather than a student's 
interpretation of the task. The students were often unaware that such alternative 
representations existed or that they might hold such significance. Some images of the 
task, for instance, such as those dominated by the goals of comprehension, summary, 
and simple response, offered little or no place for critical response, original synthesis, 
or interpretation for a rhetorical purpose. 

The reading-to-write task students imagined for themselves also had a direct 
effect on perfomiance: it affected the goals they set, the strategies they used, and the 
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ways they solved problems during composing. And it led to differences in teachers' 
evaluations of the texts-although, this study suggested, these evaluations may confuse 
the conventions of organization (e.g., use of topic sentences) with the writer's control 
of ideas. When students began to examine their options and attempt the more 
demanding task of interpreting for a purpose, certain students, whom we called the 
Intenders, showed important changes in their writing and thinking process. These 
changes, however, were not evident in the text and nor apparent to teachers. Finally, 
this study showed how students' images of the task were rooted in the students' 
histories, the context of schooling, and cultural assumptions about writing which they 
brought to college. 

It is not surprising to find that some of the images students bring with them are at 
odds widi the expectations they encounter at a university. However, when the 
expectations for "college-level" discourse are presented in oblique and indirect ways, 
the transition students face may be a masked transition. That is, the task has changed, 
but for a number of reasons, the magnitude and real nature of this change may not be 
apparent to students, even as they fail to meet the university's expectations. 

One of the key implications of this study is that reading-to-write is a task with 
more faces and a process with more demands than we have realized. We see students 
thinking hard and doing smart things, even when they misgauge their goals or their 
written text fails to meet certain standards. This close survey of the cognitive and social 
landscape of reading-to-write in a college class gives one added respect for the students 
m this transition and for the complexity and sophistication of the "freshman" task as 
they face it. 

The Reading-to-Write Project was carried out as a collaborative effort at the 
Center for the Study of Writing, at Carnegie Mellon. We designed the study to create a 
range of alternative perspectives on the process of reading-to-write and on the way 
cognition is shaped by the social context of school. The following technical reports 
present the design and collaborative history of the study; analyses of the cognitive 
processes we observed, of the texts, and of students' perceptions of both; and a set of 
conclusions, from different theoretical perspectives, on how students manage this entry 
into academic discourse: 

Reading-to-Write Report 1. Studying Cognition in Context: 
(CSW Tech. Report 21) Introduction to the Study. 

Linda Flower 

Reading-to-write is an act of critical literacy central to much of academic discourse 
This project, divided into an Exploratory Study and a Teaching Study, examines the 
cognitive processes of reading-to-write as they are embedded in the social context of a 
college course. 

Reading-to-Write Report 2. The Role of Task Representation in 
(CSW Tech. Report 6) Reading-to-Write. 

Linda Flower 

The different ways in which students represented a "standard" reading-to-write task to 
themselves led to marked differences in studen: -' goals and strategies as well as their 
organizing plans. This raised questions about the costs and benefits of th-^sc Uternative 
representations and about students' metacognitive control of their own reading and 
wnting processes. 
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Reading-to-Write Report 3. Promises of Coherence, Weak 
(CSW Tech. Report 22) Content, and Strong Organization: 

An Analysis of the Student Texts. 

Margaret J. Kantz 

Analysis of students' Organizing Plans (including free response, summary, review and 
comment, synthesis, and interpretation for a rhetorical purpose) also revealed a hybrid 
plan in which certain coherence conventions gave the promise of synthesis while the 
paper's substance reflected a simpler review and comment strategy. Both students and 
teachers, it appeared, may sometimes confuse coherence strategies (for text) with 
knowlfxlge transformation strategies (for content). 

Reading-to-Write Report 4. Students' SeIf.Analyi;es and Judges' 
(CSW Tech. Report 23) Perceptions: Where Do They Agree? 

John Ackerman 

Any writing assignment is a negotiation between a teacher's expectations and a 
student's representation of the task. Students' Self- Analysis Checklists showed a 
strong shift in perception for students in the experimental training condition, but a 
tellingly low agreement with judges' perceptions of the texts. 

Reading-to-Write Report 5. Exploring the Cognition of 
(CSW Tech. Report 24) Reading-to- Write. 

Victoria Stein. 

A comparison of the protocols of 36 students showed differences in ways students 
monitored their comprehension, elaborated, structured the reading and planned their 
texts. A study of these patterns of cognition and case studies of selected students 
revealed both some successful and some problematic strategies students brought to this 
reading-to-write task. 

Reading-to-Write Report 6. Elaboration: Using What You Know. 
(CSW Tech. Report 25) Victoria Stein 

The process of elaboration allowed students to use prior knowledge not only for 
comprehension and critical thinking, but also for structuring and planning their papers. 
However, much of this valuable thinking failed to be transferred into students' papers. 

Reading-to. Write Report 7. The Effects of Prompts Upon 
(CSW Tech. Report 26) Revision: A Glimpse of the Gap 

between Planning and Performance. 

Wayne C. Peck 

Students who were introduced to the options of task representation and prompted to 
attempt the difficult task of "interpreting for a purpose of one's own" on revision were 
far more likely to change their organizing plan than students prompted merely to revise 
to "make the text better." However, the protocols also revealed a significant group of 
students we called "Intenders" who, for various reasons, made plans they were unable 
to translate into text. 
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Reading-to-Write Report 8. Translating Context into A ^tion. 
(CSW Tech. Repor.' 27) John Ackerman 

One context for writing is the student's history of schooling including high school 
assignments and essays. Based on protocols, texts, and interviews, this report 
describes a set of "initial reading strategies" nearly every freshman used to begin the 
task-strategies that appear to reflect their training in summarization and recitation of 
information. From this limited and ofte i urexamined starting point, students then had 
fo construct a solution path which either clung to, modified, or rejected this a-rhetorical 
initial approach to reading and writing. 

Reading-to-Write Report 9. The Cultural Imperatives Underlying 
(CSW Tech. Report 28) Cognitive Acts. 

Kathleen McCormick 

By setting reading-to-write in a broad cultural context we explore some of the cultural 
imperatives that might underlie particular cognitive acts. Protocols and interviews 
suggest that three culturally-based attitudes played a role in this task: the desire for 
closure, a belief in objectivity, and a refusal to write about perceived contradictions. 

Reading-to-Write Report 10. Negotiating Academic Discourse. 
(CSW Tech. Report 29) Linda Flower 

Entering an academic discourse community is both a cognitive and social prwess 
guided by strategic knowledge, that is, by the goals writers set based on their reading 
of the context, by the strategies they invoke, and by their awareness of both these 
processes. As students move from a process based on comprehension and response to 
a more fully rhetorical, constructive process, they must embed old strategies within 
new goals, new readings of the rhetorical situation. However, for both social and 
cognitive reasons, this process of negotiation and change that academic discourse 
communities expect may not be apparent to many students for whom this becomes a 
confusing and tacit transition. 

Reading-to-Write Report 11. Expanding the Repertoire: An 
(CSW Tech. Report 30) Anthology of Practical Approaches 

for the Teaching of Writing. 

Kathleen McCormick etal. 

One important implication of this entire study is that students themselves should come 
mto the act of examining their own reading and writing processes and becoming more 
aware of cognitive and cultural implications of their choices. This set of classroom 
approaches, wntten by teachers collaborating on a Reading-to-Write course that grew 
out of this project, introduces students to ways of exploring their assumptions and 
alternative ways of represent aspects of the task. 
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STUDENTS' SELF-ANALYSES AND JUDGES' PERCEFI IONS: 
WHERE DO THEY AGREE? 



By 

John Ackcrman 
University of Utah 



The task of forming a clear representation of an assignnnient is a challenge for both 
teachers and students of writing. From the standpoint of the teacher, assignments 
comprise the heart of the writing course where theories of learning, senaestcr 
objectives, and target skills arc translated into an occasion for practice and assimilation 
(Bartholomae, 1982), For the student a writing assignment is an exercise in 
pra^natics. Each student must decide how to represent the information before her, 
mediating the teachers* expr'nt and iinplicit requirements while at the same time 
reconciling what is possible and desirable. These decisions zpptdi at times to come 
quickly, with little evaluation, die product of years of schooling. Yet, for a given 
assignment, students surprise us with their diversity and inventiveness when they face 
a range of choices and consequences. 

It is not surprising, then, that the assignment given by an instructor and the 
assignment taken by a student are not in many cases a reciprocal fit Giving and 
responding to an assignment is an act of negotiation that depends on a number of 
variables. Among them are: 

• the feasibility of teacher expectations (is the assignment doable as it is 
presented?) 

« the clarity with which an assignment is presented 

• a given teacher's willingness and ability to alter or tailor an assignment 

• the student's history with whatever genre or type of writing is sought 

• the student's familiarity with a topic and facility witfi the preferred 
language 

• a student's stature in class and the personal circumstances that surround 
an ar* of writing 

• pracv, jal constraints resulting from other assignments in school and out 

This formidable list could mean that assignments have so many variables that 
reasonable agreement between teachers and students is impossible. This of course is 
not the case-diversity and complexity do not prohibit the s'lccessful completion of an 
assignment Instead, the list of variables illustrates the multiplicity of contributing 
factors involved in representing and acting upon an assigned piece of writing. 

In Report 2 of this series Linda Flower argued that, first, a task is something 
people constmct even when they assume there is a common sense version everyone 
would hold and, second, the level of complexity for a given task can vary enormously . 
In other words, although we gave our students a writing assignment that involved 
reading from sources-a common academic assignment-we expected a variety of 
approaches. But on a practical level what does it mean for students to represent a task 
(fiffcrentiy? Do varied representations bring noticeably diifferent results, in tliis case, in 
the type and quality of a draft? And how does the range of student representations 
match their instructors' perceptions, a critical question if for no other reason than an 
instructor's perceptions eventually translate into an evaluation and a grade? 

The stud[y of task representation presented here explores how students and 
teacher's perceive the same assignment . We compared the reported renresentations of 
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the rcading-to-write task from our freshman writers with the essay evaluations from 
trained judges. We did not assume that a trained judge simulates the evaluation 
pnx:eduies of a teacher, who often (and wisely) tailors a text evaluation to a given 
student's progress or to shifting deroands in an academic writing situation. Yet we 
wanted to know how the consensus of three judges (teachers who designed and taught 
the course) compared with student perceptions. We found that teachers who served as 
judges and students who composed the essays disagreed (67% of the time) far more 
than ttey agreed on features in the final products. However, we also discovered that 
these rival perceptions could be tempered somewhat by prompting and instructing 
students to "interpret with a purpose" when they revised a first draft. As mentioned in 
the Introduction, one class period was devoted to listing and describing the categories 
of information and decisions that accomplished writers often address when they write 
from sources. The students who received this instruction tended to revise their essays 
to incorporate mm complex and sophisticated rhetorical plans, and the g^ between 
teacher md student perceptions was lessened. 

We also learned that the bases for the different perceptions and expectations are 
the more interesting and practical findings from this stiKiy. By looking closer at the 
range of decisions the students faced and their responses as they wrote, we can 
understand better how students negotiate our assigrmients and how we can best 
intervene. This report begiris with a summary of die student accounts of how tfiey 
composed a Gisi draft. Tallies and comparisons of their reports provide a basis for 
contrasting how students and teachers evaluated the same essays. Conclusions from 
these comparisons point toward common?Jities in student task representations and 
toward ways teachers can predict stodents* initial responses to a writing assignment and 
guide revision. 

The Study 

The analysis reported here centers on a Self-Analysis Checklist, one component 
in the 'Teaching Study" which also includes the reading-to-write assignment, the 
lecture on the concept of task representation as described in Report 2, and a prxx:edure 
for independently rating the student essays. During a regulariy scheduled class lecture, 
students were given the Self-Analysis Checklist (S-AC) which briefly described five 
major decisions that a range of writers made working through the same assignment: 

• Major Sources of Topic Information - ranging ft-om text-based 
ideas to the student's own experience with the topic 

• Text Format - the image a writer has of the type of prose desired, 
fiom summaries to persuasive essays 

• Organizing or Rhetorical Plan for Writing - witfiin the text, the 
way a writer arranges and presents information 

• Strategies - nine practical concemj; and approaches to finding and 
shaping ideas for a draft 

• Goals - twelve general purposes and objectives tfiat appear to guide 
composing. 

The 40 minute lecture detailed the range of options that accompany each of the 
five decision categories with examples and as much time for questions as possible. 
These options also appeared on the S-AC (Appendix I). 



At the beginning of the lecture, the S-AC was handed to each student. While they 
listened and refened fo their drafts, they selected the decision options that best 
represented how they had composed the paper. In this way the checklist augmented the 
lecture by asking students to make links between the lecture and their own writing. 
The checklist also provided an outline, summarizing and illustrating key points in the 
lecture. For example, while the students listened to a description of a major 
consideration for a writer, the Source of Topic Information, the checklist offered four 
common options: assigned texts (readings), a mix of text ideas and personal 
commentary, prior experience related to the topic, and previously learned concepts 
which could bie applied to the writing. In addition, each option was accompanied by 
descriptions and definitions written in short, personal and complete sentences. 
Students also had the option to present and describe their ovm opdon for t^^s decision 
and the four decisions that followed. Throu^out the lecture, then, with their drafts 
and the checklist before them, the students recalled and recorded the decisions they 
made as they composed 

The S-AC was central to our exploration of how our students represent their 
assigned writing since it eventually captured the reports of 72 students across four 
sections of freshman writing. These guided reports do not provide the detail found in a 
protocol analysis or other forms of cued recall. The checklist dc es, however, indicate 
in a balanced, consistent way how four sections of freshman writing, using our 
framework, perceived their composing. A guiding premise in this study was that the 
representation of an act of conq)osing matters at least as much as the decision processes 
and circumistances inferred from final products or coded in a "think aloud" transcript. 
Since one of our general goals as researchers was to surmise how writers and readers 
construct and reconstruct the same text differently, our students' personal 
representation of an academic writing task became an object of research worthy of time 
and interest 

Besides offering a relatively accurate and consistent way to recollect how a 
writing assignment was perceived, we hoped that the S-AC would serve as a tool for 
inquiry. It might help students evaluate future pieces of writing, anticipate a useful 
approach to a draft, or provide a vocabulary for talking about writing in college. In 
class discussion following the task representation lecture, we learned that many 
students were surprised and encouraged to discover that their decisions and strategies 
are common and therefore acceptable, creating for some students a currency in what 
they normally do. For other students, the checklist was also an organizing tool for 
sorting through at least some of the myriad of decisions they normally face in writing. 

To restate, both groups, experimental and control received a follow-up 
assignment to revise their first draft of the time management essay. As tiie experimental 
group received instruction in "orpanizing plans" and an introduction to writerly issues 
in task representation, tiiey completed tiie S-AC. One week later, when tiie second 
draft of the assignment was due, both groups received the checklist The experimental 
group, of course, completed the S-AC on their revisions while the control group 
received the lecture (minus the revision assignment) and the introduction to the 
self-analysis procedure. This system gave us two major comparisons. The perceptions 
of the experimental group could be compared over two drafts of the same assignment, 
and the two groups of students could be compared according to their revisions. 

The final component in the study, an independent ratmg of the first and second 
drafts, adds another perspective to the students* reported perceptions. Three instructors 
weie trained and asKed to blind rate the student essays according to the four "organizing 
plan" options introduced in lecture and listed on the S-AC. The raters' decisions 
resembled those of a teacher who must evaluate a paper largely on explicit text features. 
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These ratings and eventually the comparisons between student and teacher perceptions 
are limited to organizing plans because we assunied that rhetorical plans would 
dmninate how students finally composed and would appear in their tlnal products 
(Meyer, 1982). 

To clarify dieir judgments, die raters refined the four options listed for the 
students under organizing plans (see Kantz, Report 3). The student category of 
Summary was expanded to include the following categories: Sununary, Review and 
Comment, Main Idea, and Frame. This extension was not inconsistent with what the 
students heard in lecture. As students filled out the checklist tfiey were told to select 
Summary if their plan had been to summarize (or review) and comment For this 
analysis "Summary" includes both summary and its variants. 

What Our Students Reported 

The presentation of die study findings begins widi how students reported tfieir 
task represcntaticm using the S-AC We must interpret diese findings witfi caution 
because the checklist data depend in part on recollecticm and because we could not 
monitOT influences such as die lecture environment (pacing, distance bom speaker) 
much less attitude or proximity to firiends. Our impression, however, fkom 
administering the checklist and fiom talking with students in class following the lecture, 
was tfiat students took diis exercise seriously like any otfier classroom exercise in the 
semester (which is what it was meant to be). The data created both a context for 
exploring why and how the students composed two versions of the time management 
tshsy and a basis for cwnparing die students* perceptions and tfiose of die independent 
judges. The S-AC presented five majcar decisions in task representation. Beginning 
with the first three decisions- "Source of Inforaiation, Format, and C^ganizing Plan" - 
students could only choose one option which allowed us to compile the frequencies 
reported bel m. For the remaining two decisions- "Strategies and Goals" -students 
were cnco jraged to select more than one option, creating more of a cumulative measure 
and allowing the checklist to account for more idiosyncrasies between students as will 
be discussed later in this paper. 

Three Decisions: Source of Information, Format, Organizing Plan 

Table 1 compares for drafts one and two the experimental group's declared 
sources, formats, and plans. To simplify die table and focus discussion, "\ie only 
options listed are those that received die most attention ftom students (highest 
frequencies). A complete listing of the selections and frequencies from the 
Self-Analysis Checklist can be found in Appendix H. 



Draft #1 



% 
32 
54 
15 



Draft #2 % 



Source 



Text 

Text and Comments 
Prior Knowledge* 



06 
41 
53 



Format 



Standard Theme 
Summary + Opinion 
Persuasive Essay 



50 
25 
07 



24 
24 
47 



Plan 



Summary 
Synthesis 

Interpret with a Purpose 



43 
25 
11 



18 
12 
59 



* For brevity in Table 1 and 2, "What I Already Knew" and "Prior Concepts" from the Checklist 
are collapsed under one heading, Trior Knowledge," to focus the comparison between text-based 
and experience-based ideas. 



We wanted to know if the lecture and revision instructions lead to a shift in 
student perception and helped them revise their drafts. As Table 1 illustrates, on the 
first draft tli? experimental Group reported primarily drawing upon Text (32%) and 
Text + Comment (54%) as sources of information for their essays, accounting for 86% 
of all selected options in this category. These students also tended to prefer, a Standard 
Theme format (50%), and plans to Summarize (43%). This set of options all decreased 
in the revision, sometimes dramatically. For their revision, students reported 
depending on Prior Knowledge* as a source of information (53%), a Persuasive Essay 
as a format, and the assigned plan to Interpret (59%). 

This shift suggests that the lecnire and assignment led to a change in 
representation, a change toward the explicit goal of the assignment to "interpret with a 
purpose." We do not ignore the normative influences of a public lecture or our 
students' own eagerness to be seen as "good students"~they could have been telling us 
what they thought we wanted to hear. Evidence to the conirar;', however, comes with 
the number of students reporting what was not assigned (41% chose options other than 
Interpret). The checklist also was introduced as a personal exploration into the 
students' representations of how they composed. Through the Reading to Write 
course their teachers had encouraged self reflection and an awareness of reading and 
writing as a social and cognitive process. And, as mentioned earlier, when the students 
made their selections, they were reminded to refer to their drafts as an aid to memory. 
Therefore, we read this self analysis, with due reservations, as a meaningful indicator 
of what students thought they were indeed doing. The experimental group perceived 
their first drafts as text-based, standard theme, sup-maries primarily, and their revisions 
tended more to be seen as depending on prior knowledge to construct persuasive 
interpretations. 

Table 2 below, lists the reported options for the same three decisions, cast this 
time according to the second major comparison in the study, the revisions of the 
experimental and control groups. 



Table 1. The Task Representation Options Selected 
by the Experimental Group for Drafts 1 and 2. 
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_ EjsBcnmemal % CommL % 

Source Text and Comments 41 66 

Prior Knowledge* 53 ig 

Format Summary + Opinion 24 21 

Standard Theme 24 58 

Persuasive Essay 47 18 

Plan Synthesis 12 58 

Interpret ^th a Purpose 59 15 



Table 2. The Task Representation Options Selected by the 
Experimental and Control Groups When They Revised 
to Produce Draft #2. 

Did the different revision instructions lead to different self perceptions? 
Apparently so; the reported representations for the two groups differ at each option 
shown here. The control group's revision decisions look much like those associated 
/Si® expcnmental group's first draft (66% vs. 54% for Text and Comments, 58% 
vs. 50% for Standard Theme) Usted in Table 1. The exception to this trend is the high 
percentage of plans to Synthesize for the control group. For this group, the instruction 
to make better ' lead sosae students to change fiom Summary to an attempt to 
synthe^. The similarity between draft one (experimental) end die revision (control) 
coupled with the experimental group's preference for Prior Knowledge as a source. 
Persuasion as a format, and Interpretation as a plan support the claim that 
representations did vary between groups, foUowing the lecture on task representation. 
As noced, the difference m organizing plans is stiiking. Random sampling should have 
guaranteed that the two groups had equivalent abilities and both groups revised under 
roughly the same circumstances. TTie experimental group saw themselves as writing a 
more puipoMful" statement oi- ume management, one that integrates more personal 
knowledge of the topic and attempts to engage an audience. This perception will be 
te- 'VI later against the scores of the trained raters. 

If stock is taken in the highest percentages from the data, a generic student for 
each gt>up be^ to emerge. Although correlations betv/een options are difficult to 
infer from the fiequcncies listed in Tables 1 and 2, the percentages imply certain 
patterns of behavior. For example, a Synthesis written in a Standard Theme format 
usmg Text ideas plus Comments is a plausible schema for writing a typical fieshman 
essay involvmg sources. In reality, none of our students exacUy fit the profile of the 
generic student" Not one of 72 students participating in the study chose each of the 
SIX most popular options. This fact matches our intuition and early prediction that 
students have diverse and con5)lex lepresentations of a reading-to-write task. The 
value of seeing the patterns of task representation Ues in understanding the assumptions 
and habits that students bring to a piece of writing. If we can draw a bead on those 
assumptions and familiar strategies-even in a hypothetical way--we can more 
accurately offer guidance to students and alternative ways to progress. 

-Within the general trends evidenced thus far, there appear to be correlations 
among reported perceptions by both groups that are worthy of attention. The options 
most often selected by students arc illustrated in Figure 1 . The figure is read by 
beginning with the highest number in a row. For example, in the first row of the 11 
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students who chose Text selections, 8 also chose Standard Theme and of those 7 chose 
Summaiy. And in the last row, of the 17 control students who wrote Standard 
Themes, 10 reported reliance on a Standard Theme format Shaded areas correspond 
with categories where no clear trend was apparent, and thus there is no 
correlation to consider. 



SOURCE 



FORMAT 



PLAN 



1 1 TEXT 



8 STANDARD 
THEME 



7 SUMMARY 



GROUP 



E & C 



15 TEXT 
and COMMENTS 



(n* mor* than 5 of 
any of tho formats) 



7 SUMMARY 



14 TEXT ♦ TEXT 
and COMMENTS 




|ia|p5iHai|mHii!ii8ii:i:i: 






14 SUMMARY 



13 STANDARD 
THEME 



14 SUMMARY 



10 PERSUASIVE 
ESSAY 



10 INTERPRET 



10 STANDARD 
THEME 



17 SYNTHESIS 



E & C 



E & C 



E & C 



Figure 1. Interrelationships among Source, Format, and Plan 



Figure 1 show; that connections are higher among pairs of decisions. For 
example, the Text option under source correlates fairly £ghly with a Standard Theme 
format and Summary plan. In fact, the only plan that connects with source options is a 
Summary. This implies that if a student chooses a Synthesis or Interpret plan, the 
infoTOMition for those papers will come from a variety of sources. A strong relationship 
appears to exist between Summary plans and Standard Theme formats for both groups, 
as we might predict After all, the utilitarian Standard Theme is often characterized as 
consisting of stock arrangements of generally recognizable ideas (Bartholomae, 1985). 
A strong relationship also appears between the Interpret plan and the Persuasion format 
(experimental group). The relationship between dominant formats and plans does not 
appear to carry for a Synthesis (control) which poses the questions: Do syntheses 
invoke a wider range of formats (the opposite seems likely)? Or, is the difference a 
perceptual issue, perhaps tied to the difference in tasks? To sum up, students seem to 
create clusters or pairs of options such as plans to summarize and standard theme 
format and persuasive formats and plans to interpret However, the correlations 
suggested by these data are tentative at best and we are skeptical that such simple 
patterns exist given the complex nature of the task representation phenomenon. 

StrategU « and Goals 

So far the data have shown that there are patterns in how the groups, using the 
S-AC, responded to an explicit request to interpret their decision prx)cesses and final 
products. We found differences between first and second drafts for the experimental 
group and differences between experimental and control groups . The patterns 
illustrated above show that, while no generic student exists, there are meaningful 
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couplets that provide insights into the thinking patterns that lead to certain types of 
student drafts. The last two decisions presented in the lecture on task representation 
and on the checklist, strategies and goals, should be scon as supplementary 
information. The students could select one or more options under each decision to try 
and paint a clearer picture of their task representation. In addition, we asked each 
student to "predict" what strategies and goals a "graduate student" would bring to a 
similar piece of academic writing. Table 3, like Tables 1 and 2, lists only those 
selections that received the most attention from the students, (see Apper lix I for a 
complete listing). 



Experimental Control 

draft! % stafLl % draft 2 % 

Strategies Gist & List 16 03 02 

Skim & Respond 16 06 11 

Organizing Idea 18 23 20 

Aidience Needs 02 11 n 

Own Purpose 06 17 07 



Goals 

Present Learning 20 06 09 

Do the Minimum 13 04 07 

Page Requirement 12 00 03 

Influence Reader 00 20 05 

Cover Key Points 18 08 14 

Originality 00 10 11 



Table 3. Strategies and Goals* 

•These percentages arc calculated from the total number of selections, not the total number of 
students making selections. 



Table 3 s clearest message is that one strategy or goal does not dominate the field. 
The vanety of options selected indicates the complexity of the students' decision 
processes in contrast with patterns or trends. Student choices varied widely, and all of 
the 21 options in both categories drew responses (and no student wrote in "other" 
options). Interesting differences appear between the first and second draft for the 
expenrnental group. These students paid more attention to an Organizing Idea (23%) 
« X ^ Purpose (17%) as strategies and to the goal of Infiuencing a 

Reader (20%) m the revision, though the latter two of these selections were not 
promment in the selections made by the contiol group. 

In the preceding section of this report, the possibility of patterns among decisions 
was explored. A similar question would be whether any of the goals and strategies 
appear to cluster around, for example, a plan to interpret or synthesize. When strategy 
and go^ options were compared with plans, we found that a given plan elicited the full 
range of strategies and goals with no clear trends in the proposed connections between 
decisions. The strategies and goals fteshmen predicted for the older students, 
however, did reveal a trend. Both groups were remarkably consistent in their 
prediction (+ or - 02% on all but "audience needs"). Collectively, on the checklist and 
later in class, the students predicted that older students would be more concerned with 
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•originality" (repitscntcd by the Springboard strategy for their own ideas and 
Originality as a goal) and "audience." Graduate students were thought to have more 
time and control over their work since they wrote to peers and mentors who appreciated 
the creation of a personal firanac addressing a reader. This revelation helped to focus 
discussion later in class. We explored why many students saw their roles as academic 
writers limited in comparison to older students, and in doing so we began to examine 
several of the assumptions underlying our students' noticxis of authority and originality 
in school 

The number of common perceptions, patterns between decisions, and even the 
diversity of options students report^ choosing raise the thorny issue of what to do 
with this description of student thinking, beyond puzzling over it Should discrete 
decisions or patterns of representation be taught? We think not There is no evidence 
so far that oat representation leads safely to a successful final draft One virtue in this 
whole enterprise was the added ammunition to show students that a safe route to an "A" 
paper does not exist At best the trends and shifts in student perceptions do suggest 
ways to anticipate and predict reasonable behavior for a writer in a given situation. For 
example, from the students' vantage point, an exclusive investment in Text material as a 
source of information for a draft probably will not lead efficiently to an Interpretation as 
sources that tap Prior Knowledge. The tmc metal of these perceptions, however, will 
appear when they are tested against the judgments of others. After all, if a piece of 
writing goes public, its worth is largely defined by the reader's perception of its 
message. 

Organizing Plans 

To compare the students' perception of their papers, specifically the organizing 
plans, with the rhetorical plan readers might respond to in the texts, both versions of 
the essays were submitted to a rating by three independent judges. The judges were 
asked to sort the papers on tlie basis of seven essay cate^Mies. Because the categories 
used extended the categories on the students* checklists, the judges were allowed to 
make fiiwr distinctions between drafts. Figure 2 shows both the students' options for 
organizing plans and the judges' elaborated categories. 

aiUdfiHtS Judi?es 



• summary • summary 

• - • review comment 

« * » • isolated main point 

• frame 

• response • response 

• synthesis • synthesis 

• interpret • interpret 



Figure 2. Categories of Essay Plans. 



Before looking at how judges' and students' perceptions compared, it would be 
helpful to characterize any trends or patterns in the judges' scoring. In contrast to the 
student selections, listed and categorized above, the raters showed relative balance 
across all seven categories for both drafts. For example the students labeled 72% of 
their revised papers either a Synthesis or Interpret with a Purpose plan. The raters, in 
turn, used these categories more conservatively to account for only 42% of the 
organizing plans. The conservative nature of the judges' scoring m;:y be a result of 
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their training, their experience as readers of academic writing, or refinements in the 
coding scheme. At any rate, this difference forecasts the categories on which students 
and judges disagreed. 

Agreement between Students and Raters 

Of the 72 possible comparisons between the experimental and control students 
and the judges evaluations, 67 comparisons were made. The loss of five comparisons 
resulted from students who failed to attend lecture, complete the second checklist, or 
turn m a revised essay. The percentage of comparisons remained consistent across 
bofli versions of the essay and across groups. As stated in the introduction of th's 
report, students and judges agreed on all organizing plans for both drafts 37% of the 
tune, nus low agreement suggests that they saw different texts~dr brought different 
CTitena to the judgment process, or both. Looking closer at specific agreement and 
disagreement, the raters and smdents reached agreenaent more often with the more 
complex organizing plans: Syndieses (5 of 25), and Interpretations (4 of 25) although 
the mdividual rates of agreement for plan are not strong (no higher than 20%). No 
pattern of disagreement appeared save the disproportionately high number of 
mismatches for Response plans. Only one smdcnt labeled any draft a Response while 
the judges found seven. This judgment may have been affected by the lower value 
placed m the classes or during the lecture on a "personal response" to the topic (vs. the 
readmgs) in the context of an assignment where critical reading of outside authorities is 
stressed. 

Agreement shifts noticeably from the first draft to revision, but not from one 
group of smdents to the next In the first draft comparisons (all with the experimental 
group), agreement was higher at 48% than the overaU average of 37%. In the second 
draft, agreement for both groups with the judges dropped to around 33% (30% for 
control and 35% for experimental). Two reasons for the across-the-boaid drop are 
possible. First, students in the experimental group, who were attempting a more 
complextask, may have had more difficulty either recognizing or canying out such 
plans. One way of considering the instruction in task representation as successful is to 
iwedict that it leads to a more accurate but compUcated picture of the task. Predictably 
this complexity would hinder their ability to label and carry out text plans since they 
were asked to rethink text features and their assumptions about essay writing Or 
concentration simply may have dropped when the smdents were asked to judge their 
tfic OTurS*^ preparing to move along to other assignments in 

To understand furtlier where smdents and judges agreed, signal detection analysis 
was us«i to separate and plot the number of smdcnt decisions for a given plan against 
those of the raters. A signal detection analysis of the checkUsts and ratings presents not 
only the mstances diat smdents and judges agree or "hit," it also scores "misses" and 
taise alarms. The latter two measures help us to understand the nature of the 
disagreement between smdents and judges. Since signal detection analysis depends on 
a staiKtod, fixed score, the judges' expertise and decisions were taken as our assumed 
standard for assigmng hits, misses, and false alarms. A "miss" in this case occurs 
when a smdent says "yes" to a plan when the text has been rated something else, and a 
false alaim occurs when a smdent fails to recognize a given plan. 

To say that our judges have the final word made intuitive sense in that a teacher 
must decide and act upon some standard for evaluating papers, however arbitrary In 
using signal detection analysis, we do not ignore the opening claim of this report-that 
what IS possible and acceptable in a writing assignment is practically and finally 
negotiated between teachers and students. Nor do we forget that trained raters do not 
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proceed in the manner of a teacher evaluating a class's performance or a writer's 
self-evaluation of a draft. To compare teacher and student perceptions, a standard must 
be assumed, and v e chose the consensus reached by three teacher-evaluators. Figure 3 
portrays die four possible comparisons inherent in signal detection analysis. 



Ne 
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No 



To««l 



ioih Sty 
T«f 


" Ftlf • AUrm 

Jttd(M No 

Stttd*ntf Y^f 


Ym 


■ Kin 
StadtA^f No 
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BoihSty No 


No 




No 


67 



Figure 3. Comparisons in Signal Detection. 

For the signal detection analysis, the judges' extended Summary categories were 
collapsed so that we could score all four student options. For Summary, this meant 
that a student judgment was scored a hit if it matched any of the judges* first four 
categories. Figure 4 lists the scores for each of the four student text plans. These 
scores are included in this report to show the reader how the judges labeled the essays 
in the 67 comparisons and where students agreed with those labels. 
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Interpret 
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49 


8 


59 
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Figure 4. Scores from Signal Detection for Four Text Types. 
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The 67 possible conq)arisons become the total number of possible hits or chances 
for complete agreement The four totals for the "yes" column (bottom left comer) 
illustrate how tlie judges used the four categories of text plans to label the student 
essays. Judges found most often Summaries (39) and Syntheses (13) as the collapsed 
categories might predict The 37% agreement for students' and judges' perceptions 
across all plans can also be checked by dividing the number of hits (for example, 14 for 
Summaiy, 6 for Synthesis...) by the judges' total "yes" for all plam (or 67). The 
probability of student "hits" and "false alarms" is listed below in Figure 5 and shown in 
the accompanying graph. By plotting hits against false alarms it is easier to see the 
relative power of the hits in a given category of text plan. The ideal location on the 
ffaph would be high along the vertical axis and to the left along the horizontal, meaning 
that hits would far exceed the probability of false alarms. 
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Figure 5. Probability of Students Making Hits and False Alarms. 



The signal detection analysis shows us that students arc fairly accurate in judging 
a Summary insofar as they rarely label their texts a summary when a text is something 
else (probabiUty of a false alarm = .03). The low hit rate (.37), however, means they 
often thought texts had a more complex organizing plan than the judges did. Since 
students almost completely avoided the Response plan, when judges were categorizing 
texts as Summaries, Review and Comment, Main Ideas and Frames, students were 
seeing themes as Syntheses and Interpretations. With these latter plans, the students 
hai a higher hit rate (.54 and .50 respectively), with a higher false alarm rate as well 
(.29 and .24). Generally, they saw complexity when to a reader's eyes, complexity 
was not there. r / 
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Conclusions with Implications for Teaching 



This itport opened with the twin premises that fomiing a clear, practical 
representation of a writing assignment is a challenge for both teachers and students and 
that the level of canplexity between one representation and another can vaiy 
enormously. Certainly if we look at the wide range of Goals and Strategies reported by 
both student groups alone, complexity and individuality are the nona Even though 
trends and patterns in student percepticxis appeared in the summarized totals frc)m the 
Self-Analysis Checklists (Tables 1, 2 and 3), a "generic student" does not exist. The 
checklist presented five major decision areas witii over 30 options, and students took 
advantage of die entire corpus to describe tfieir essays. The data can be read, then, as 
evidence for the high number of contributing factors involved in representing a writing 
assignment 

Any further conclusicMis from this data must be considered against the problematic 
nature of inquiry into teachers', students', or anyone's perception of a complex task. 
For our analysis we chose to assume diat judges' perceptions approximated teachers' 
perceptions, that our self-analysis instrument tapped in a consistent way important 
considerations in the students' composing, that our Judges' basis for evaluating essays 
was rcascMiably comparable to die students' (^plication of die text-plan categories. 
Tracking out perceptions is messy, yet the compiled frequencies of student selections 
did illustrate shifts in reported perceptions and patterns or connections among task 
decisions and options. At the very minimum these shifts and patterns help the 
teacher-researchers in this study to understand, in the context of tiiis reading-to-write 
assignment what it means to represent a task differentiy. The lecture on task 
representation and directions to revise to "Interpret with a Piupose" appeared to lead to 
shifts in perceptions: for the experimental group Prior Knowledge as a source of 
information^ Persuasion as a format, and Interjnetation as an organizing plan all 
increased following die lecture with specific revision directions. From another angle, 
the control group who revised without specific instructions produced a second version 
of the time management essay similar to the experimental group's first draft, except for 
the proportionately high number of Synthesis plans. Assignment directions and 
instmction in the five major decisions at least contributed to tte contrasting perceptions 
in the two groups. 

Shifts in perception, however, do not equate with finished products. Student 
pCTceptions of text plans did not tend to match those of the judges and die signal 
detecticm analysis revealed that students found complexity (syndiesis and interpret 
plans) in drafts when readers did not Pertiaps a more telling contrast is the fact that the 
shifts and diffisrence in perceptions between groups did not result in any significant 
difference in final products. Though the experimental and control groups saw their 
revised text as mwe complex (15 "Interpretations" and 16 "Syntheses"), judges agreed 
widi tfiese perceptions less than 10% of die time. Also, the judges saw no difference in 
iht number of ccxnplex text plans (Syndieses and Interpretations) for both groups (11 
for the experimental, 10 for the control). 

The students' perceptions, then, could have been influenced by the goal to revise 
toward complexity, embedded in die lecture and revision duiections, rather that actual 
refinenoents diey saw in dieir texts. This mismatch between writer and reader 
perceptions helps to build a case for instruction and practice in evaluating both 
enperging and target text plans and the corresponding decisions in generating them. In 
tills light, die gap between student perceptions and die judges' evaluations mirrors the 
traditional distance between the image writer's have of their own drafts, a reasonable 
and predictable egocentricity, and a reader^s often riva^ interpretation of the same text 
(Rower, 1981; Kroll, 1978). Practice in recognizing text plans and exploring the 
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decision processes behind diem could narrow die perceptual distance between writers 
and readers so that the two can begin to build a comparable vocabulary to refer to 
academic genits and conventions. 

Casting the specific points of misperception in terms of a dialogue-how writers 
negotiate an assignment and a reader's perception of Aeir texts-places a value on 
recognizing the patterns and connections tfiat emerged from the student reports. Both 
student groups appear to associate Text sources with Standard Theme formats and 
Summary plans, a pattern that reflects "schooling" in summarizing explicit information 
in reading material (Applebee, 1984b). The commonality of this and other associations 
(Persuasion format and Inteipret plan) is suppOTted by an auxiliary question on die 
Self- Analysis Checklist Students were askc^ if they saw their decisions on the task as 
representing their "standard" strategies or goals. We explained that a standard strategy 
(or goal) would be Qrpical or especially familiar, oat that has been used to complete a 
number of academic writing assignments. They reported diat half of dieir options for 
these two decisions weit standaid, meaning they were common and somewhat 
comfortable. Practice in recognizing decision patterns and alternative strategies, such 
as the consideration of Prior Knowledge as a source of information, could help 
students to re-examine standard strategies and goals and otiier habits and 
commonplaces. If students consciously attend to assumed standanls and perceived 
risks in a writing assignment, the negotiations among teachers, students, and 
assignments may become more explicit and, thus, open for discussion and critique. 
From a cognitive perspective, students may tfien sharpen their regulatory mechanisms 
(Brown, 1985; Palincsar and Brown, 1983) which help to predict and monitor progress 
with a draft From a social perspective, die negotiation of expectaticMis and 
perceptions-can strengthen the collaborative nature of a writing classroom. We want 
to underscore die positive contribution diat die Self-Analysis Checklist made to the 
Reading to Write class. It helped students to be aware of an existing repertoue of 
thinking strate^es and of the gains and losses that one approach can bring in a given 
situation. And importandy, for some students it raised the possibility of extending and 
enriching this repertoire, an issue wluch surfaced repeatedly in classroom discussion 
through the semester. 

Practice in recognizing text plans, relationships within decision processes, and the 
interplay between decisions and final jwoducts may, in turn, nudge students toward a 
perception of writing closer to that of older, more advanced students. Awareness and 
an inaeased repertoire of strategies is a reasonable step one might take to acquire more 
flexibility, authority and "originality" in the writing of academic essays, where students 
have both a reason to write for readers and possess more means to do so. Writing for 
critical readers will remain an act of negotiation but added awareness and control over 
composing strategies and text features arc a form of "ownership" -a step, we would 
argue, toward reader-sensitive composing in die context of college-level writing class. 
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Appendix I 



SELF-ANALYSIS CHECKLIST 



rUUOR SOURCE OF INFORriATION 
0 ASSICNCD TCXr 

OTCXT« mCOnHCIITS * 

0 WHAT I ALiCADY I KNCW ABOUT THE TOPIC 
0 PtCYIOUS CONCEPTS ♦ TEXT 



check one 



TEXT FORHAT 
0 MTCS 01 A SUnmlY MRA6RAPH OR TWO 

0 SUnriARY PACMRAPNS WITH AN OPINION PARACBAPH 

0 STANDARD SCHOOL THCflC FOR ANY RtAOCR 

• I wtit M MratellM, « Mv v«h wvml f<r«fr<His, «4 nuvkt « mmIhim 

• I W* • IhMto ftMtmMl m4 tMtltMM 

a PCRSUASIYC ESSAY FOR AN ACADCHIC OR PROFESSIONAL 
PUBLICAflON 

• h iMV tmui titr**Ml<M I r«<«*4 M torn* ar feMtoiM Vi* tiirf$t »t ttw ti mv 

• I «rf M<it4 tt» U4t HTtr <fh( trmmi » vfumfnl 

D OTHER; 0«Mr** <kt ttniM (funr n*m- h •witkU (mttnMf. 
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Check one 



ORGANIZING PLAN FOR WRITING 

0 sunmsizc thc BtAOiNCS 

0 ICSPOND TO THC TOPIC 

• I ^iTMHiny twM MtM iMvt «it li^ 

• i th» ^«Nt «i4w, ^ M tt«tt4 «v«MH<«tff 

0 ORCANIZC AOOUND A SYNTHCSIZiNG CONCEPT 

• I HV*4 cIImiHmi to i» MMi «i (Ht rt««R«s 

• I fmm4 w ftivMtH • m9*f^ MMtf t to immaI f«r «Mf • Wvtt 

• t<«H • i yi i »« g l H nt MMtyl to arfMlt* (ny t«9«r 
0 INTCBPBCT rOR A PURPOSE OF fit OWN 

• I «st4 InftfiMliM s«r««t to 4* t«ii««hin« f*r • tp^ilk f^i^r tr y«rH«« 

• I t«lMto4 Mt«f fl^tm ttM /fMlAf f tr my •n^^rWrn* that fH tMt t««t 

• I trf^ittH tht tf f VMM mi m •uttWv 

0 OTHER; W^m^plm it tfffTvf Mt, ^t<r«« ft In aMctraf Wto gHi<tM#t 
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STRATEGIES 
O CIST AND LIST 

0 CIST AND LIST ♦ OPINIONS 
0 READ AS A SPRINC80AR0 FOR 
0 TELL IT IN NY OWN WORDS 
C SXm TO INTCRCSTIN6 PQlHTS AND RESPOND 
a DIG OUT AN DRCANIZING IDEA 
0 DIVIDE THE IDEAS INTO CAflPS OR SIDES 
a CHOOSE WHAT I1Y AUDIENCE NEEDS TO KNOW 
0 USE THE TEXT FOR W OWN PURPOSE 
a OTHER? DtMTD* ««ir f«r«to«i In «Mi»ltU fMtMwtt . 



ir necessory, 
check mone than one 



INKING 



check those that apply 



GOALS 

0 TO DEnONSTRATE THAT I UNDERSTOOD THE MATERIAL 
Q TO Ca A COOD IDEA OR TWO OUT OF THE ASSIGNflENT 
Q TO PRESENT WHAT I LEARNED 

0 TO COME UP WITH SOfinHING INTERESTING TO SAY 

0 TO DO THE niNinUn AND DO IT QUICKLY 

0 TO FULFILL A PAGE REQUIREMEHT 

0 TO TEST m OWN aPERIENCE 

0 TD COVER ALL THE KEY POINTS IN THE READINGS 

0 TO DE ORIGINAL OR CREATIVE 

0 TO LEARN SOnETHINC FOR flYSELF 

0 TO INFLUENCE MY READER 

G TO USE THE READING TO TEST SOnCTHING I ALREADY KNEW 
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BEST COPY AVAILABLE 



Appendix n 



Total Number of Selections with Percentages 
from the Self-Analysis Checklist 



Experimental Control 

draft #2 draft #1 draft rf2 

SOURCE N = 28-% N = 23.% N = 33-% 

text 9 -.32 1 ..06 5 -.15 

text + comments 15 -.54 11 -.48 22 -.66 

prior knowledge 1-.04 5 -.22 1 -!o3 

ptevious concept 3 -.11 5 -.22 5 -.15 

other 0-.00 l -!o4 0-!oO 

FORMAT N = 28.% N = 33-% N = 23.% 

notes/summary 3 -.11 i -.03 1..04 

summary 1/opinion 7 -.25 7 -.21 4.. 17 

standard theme 14 -.50 19 -.58 6 -.26 

persuasive essay 2 -.07 6 -.18 12 -.52 

oiher 2 -.07 0 -.00 0-,00 

PLAN N = 2S-% N = 33-% N = 23.% 

summarize texts 12 -.43 5 -.15 3. .13 

respond to topic 5 -.18 2 -.06 1 -.04 

synthesizing 7 -.2 19 -.58 3-! 13 

interpret 3 -.11 5 -.15 15-^65 

o«her 1..04 2 -.06 1-.06 



Exp 



STRATEGIES N = 49. 



gist and list 
g and 1 + opinion 
springboard 
tell it in own words 
skim and respond 
(vganizing idea 
take sides 
audience needs 
own purpose 
other 



8 -.16 
. 8 -.16 

2 - .04 
4 -.08 

8 - .16 

9 - .18 
6 -.12 
1 -.02 

3 - .06 
O-.OO 



Draft #2 
Exp Control 



N = 46-% 

2 -.04 
6 -.13 

1- .02 
5 -.11 

2 - .04 
10 -.22 

5 -.11 
5 -.11 
10 -.22 
0-.00 



N = 91-% 

2 -.02 

12 - .13 
6 -.07 

14 -.15 
10 -.11 
18 -.20 

13 - .14 
10 -.11 
6 -.07 
O-.OO 



Prediction 
Exp Control 



N = 62-' 



O-.OO 
3 -.05 

10 -.16 
2 -.03 
5 -.08 

10 -.16 

8 - .13 
15 -.24 

9 - .15 
O-.OO 



N = 49-% 

1- .02 

2 - .04 

7 - .14 

2 - .04 

3 - .06 

8 - .16 

6 - .12 
14 -.28 

7 - .14 
0-.00 




GOALS 

understanding 
get good idea 
present learning 
interesting to say 
do the minimum 
page requirement 
test experience 
cover key points 
originality 
learn something 
influence reader 
test my knowledge 



Exp 

N = 6Q.% 

6- . 10 
4 -.07 

12 -.20 

7 - .12 

8 - .13 
7 -.12 

3 - .05 
11 -.18 

O-.OO 
4. .07 
O-.OO 

4 - .07 



Revision 



Exp 

N = S7-% 

5 - .09 
4 -.07 
3 -.05 
9 -.16 

3 - .05 

0- .00 

1- .02 

4 - .07 

6 - .11 

7 - .12 
13 -.23 

2 - .04 



r<6 



Control 

9. .09 

8 - .08 

9 - .09 
18 -.18 

7 -.07 

3 - .03 

4- .0 
14 -.14 
11 -.11 

7 -.07 

5 - .05 
4 -.04 



Prediction 
Exp Control 



N = 7I 



6-.0 
2 -.03 

5 - .07 

6 - .09 
1-.01 

1- .01 

2 - .03 
6 -.09 

16 -.23 

1- .01 
22 -.32 

2 - .03 



N = 65. 



3 -.05 

2 - .03 

6 - .10 

7 - .11 
0-.00 

0- .OO 

3 - .05 
12 -.20 
12 -.20 

1- .02 
18 -.30 
1-.02 



